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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a vehicle with an image 
recognition device that is mounted on-board and can detect dirt on an 
optical system of an infrared ray cameral with a simple configuration. 

SOLUTION: When a headlight switch 7 detects lighting of a headlights ir 3 ' ^ 

21 R and 21U whether or not received luminous quantities ILR and ILL of 1 i 1 

photo sensors 2R and 2L arranged close to the infrared ray camera and C ^ 

receiving a reflected light of the light emitted from the headlights 21 R fiR'^-cznr 

and 21 L are smaller than prescribed thereshold ILREF is discriminated 

and in the case of ILR<ILFF and/or in the case of ILL/ILREF, it is a.-*^= . 

discriminated that the optical system of an infrared ray cameral [R H_J ' 

and/or 1L gets dirt, and deficiency of image contrast is warned to a \ 
driver. 

j TA [• 









H 



1 



.EGAL STATUS 

[Date of request for examination] 
[Date of sending the examiner s decision of rejection] 
[Kind of final disposal of application other than the 
examiner s decision of rejection or application 
converted registration] 

[Date of final disposal for application] 
[Patent number] 
[Date of registration] 

[Number of appeal against examiner s decision of 
rejection] 

[Date of requesting appeal against examiners decision 
of rejection] 

[Date of extinction of right] 



ittD://www19jDdl.nciDi.ffo.iD/PA1 /result /de.tail/main/wAAANIVa4vhnA41 -'^91 1A4qpi in+ 



JP,2001-211449,A [CLAIMS] 



1/1 ^-v 



^ NOTICES * 

JPO and NCIPI are not responsible for any 
lamages caused by the use of this translation. 

I This document has been translated by computer. So the translation may not reflect the original precisely. 
-.**** shows the word which can not be translated. 
J.In the drawings, any words are not translated. 



CLAIMS 



;Claim(s)] 

Claim 1] In the image recognition equipment for cars which recognizes information required for operation of the 
:ar concerned from the image which is equipped with an infrared camera and obtained by this infrared camera 
The photosensor which approaches said infrared camera, is arranged and detects the quantity of light, Image 
ecognition equipment for cars characterized by having a dirt detection means to start actuation by lighting of 
:he headlight of said car. to detect the quantity of light of the reflected light of the light emitted from said 
leadlight with said photosensor, and to detect the dirt of said infrared camera based on the this detected 
iuantity of light. 



Translation done.] 
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•= NOTICES * 



JPO and NCIPI are not responsible for any 
iamages caused by the use of this translation. 

I. This document has been translated by computer. So the translation may not reflect the original precisely. 
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DETAILED DESCRIPTION 



Detailed Description of the Invention] 

:oooi] 

Field of the Invention] This invention relates to what has the function which detects especially the dirt of the 
)ptical system of an infrared camera about the image recognition equipment which recognizes information 
equired for operation from the image obtained by the infrared camera carried in the car 
0002] 

Description of the Prior Art] An infrared camera is carried in a car, and in order to detect the object which 
ixists ahead of a car and to perform warning for collision prevention from the image obtained by the infrared 
:amera, the equipment which recognizes the object is proposed (for example, JP,1 1-328364,A). Since such 
■nage recognition equipment is what operates normally considering clear *ic**** being obtained by the infrared 
:amera as a premise, if there is dirt in covering of a camera etc., normal actuation will no longer be performed, 
"herefore. to have the function which detects the dirt of the optical system of an infrared camera is desired. 
0003] Although it is not a thing using an infrared camera, light is irradiated from the car under transit at a road 
urface, the optical ground-speed detection equipment which detects ground speed based on that reflected light 
5 known, and if the plate of the transparence in which the reflected light carries out incidence becomes dirty, 
letection of an exact rate cannot be performed in this equipment Then, a light beam is irradiated at a 
ransparence plate and the technique of detecting the dirt of the transparence plate is conventionally known 
ased on the quantity of light of the light beam by which spread the inside of a transparence plate and outgoing 
adiation was carried out (JP,5-302887,A) 
0004] 

Problem(s) to be Solved by the Invention] However, by the above-mentioned conventional technique, apart from 
he light source which carries out outgoing radiation of the light beam for ground-speed detection, the light 
ource which carries out outgoing radiation of the light beam was required because of dirt detection, and when 
implifying a configuration more, the room of an improvement was left behind. 

D005] This invention is made paying attention to this point, and it aims at offering the image recognition 
quipment for cars which enabled it to detect the dirt of the optical system of the infrared camera carried in the 
ar with the easy configuration. 
D006] 

Means for Solving the Problem] In order to attain the above-mentioned purpose invention according to claim 1 
1 the image recognition equipment for cars which recognizes information required for operation of the car 
oncerned from the image which is equipped with an infrared camera and obtained by this infrared camera The 
hotosensor which approaches said infrared camera, is arranged and detects the quantity of light, It is 
haracterized by having a dirt detection means to start actuation by lighting of the headlight of said car. to 
etect the quantity of light of the reflected light of the light emitted from said headlight with said photosensor, 
nd to detect the dirt of said infrared camera based on the this detected quantity of light. 

D007] Since according to this configuration the amount of reflected lights of the light emitted from the headlight 
f a car is detected and the dirt of an infrared camera is detected by the arranged photosensor close to an 
ifrared camera based on the this detected quantity of light, it is not necessary to establish the light source for 
irt detection, and the dirt of an infrared camera can be detected with an easy configuration. That is, the degree 
f the dirt of the photosensor arranged by this invention approaching an infrared camera and this judges with the 
ptical system of an infrared camera being dirty, when the quantity of light detected by photosensor falls from a 
redetermined threshold paying attention to the point of being almost comparable. 
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0008] Moreover, while arranging said photosensor in housing of said headlight said headlight is approached and 
'ou may make it arrange said infrared camera. Since according to this configuration the light by which outgoing 
adiation was carried out from the light source of a headlight reflects in housing and carries out incidence to 
photosensor, if housing becomes dirty, the amount of reflected lights by housing will increase, and the quantity of 
ght detected by photosensor increases. Therefore, when the detection quantity of light exceeds a 
rredetermined threshold, the headlight is dirty and it judges with the infrared camera being dirty. 
0009] The outside-air-temperature sensor which furthermore detects outside air temperature is formed, and 
vhen outside air temperature is beyond predetermined temperature, it is desirable to warn the operator of the 
:ar concerned of the contrast of the image obtained by the infrared camera falling. Thereby, since outside air 
emperature is high, ah operator can recognize that the contrast of the image obtained by the infrared camera is 
ailing, and that possibility that normal will be acquired for an image by the fall of outside air temperature if it 
luts in another way is high. The predetermined threshold forjudging the size of the detection quantity of light by 
ihotosensor measures the photosensor output in the condition of various dirt, and is experimentally set as the 
>ptimal value. 
0O1O] 

Embodiment of the Invention] The gestalt of operation of this invention is explained with reference to a drawing 
•elow. 

)rawing 1 is drawing showing the configuration of the image recognition equipment for cars concerning the 1st 
.peration gestalt of this invention. (1st operation gestalt) This equipment Two infrared cameras 1R and 1L which 
an detect far infrared rays, and the photosensors 2R and 2L used in order to detect the dirt of infrared 
ameras 1R and 1L, The headlight switch 7 which turns the headlight of the car concerned on and off. When the 
ossibility of a collision is high, while the object of the animal ahead of a car etc. is detected based on the 
•utside-airHiemperature sensor 8 which detects outside air temperature TA, and the image obtained by infrared 
ameras 1R and 1L. and processing emitting an alarm etc. While displaying the image-processing unit 2 which 
erforms processing which detects lack of the image contrast mentioned later, the loudspeaker 3 for emitting 
/arning with voice, and the image obtained with Cameras 1R or 1L It has the display 4 for making an operator 
ecognize an object with the high possibility of the lack of contrast of an image, or a collision. A display 4 
onsists of a HUD formed so that screen 4a may be displayed on the front window's of the car s 20 concerned 
'ont location of an operator, or a display of a navigation system, as shown in drawing 3 . 
D011] Infrared camera 1R, photosensor 2R, and the outside-air-temperature sensor 8 are held in camera 
ousing 11 R shown in drawing 2 , and are held in camera housing 1 1L which infrared camera 1L consists of 
Imost similarly with photosensor 2L. The camera housing 11R and 11L is attached in the front grille 22 of the 
ar 20 concerned as shown in drawing 3 . 

D012] The camera housing 11R and 11L is being fixed so that it may be arranged to the medial axis of the 
)ngitudinal direction of a car 20 in the almost object location, the optical axis of two cameras 1R and 1L may 
ecome parallel mutually and the height from both road surface may become equal. Infrared cameras 1R and 1L 
ave the property that the output-signal level becomes high (brightness increases), so that the temperature of 
n object is high. Moreover, Photosensors 2R and 2L are attached so that the light reflected from the exposure 
eld of Headlights 21 R and 21 L may be received, and they output the signal mostly proportional to the light- 
sceiving quantity of light Photosensors 2R and 2L consist of a photodiode, a photo transistor, or CCD (Charge 
Joupl-edDevice). 

3013] The A/D-conversion circuit where the image-processing unit 2 changes an input analog signal into a 
igital signal, The image memory which memorizes the digitized picture signal. CPU which performs various data 
recessing (Central Processing Unit), RAM used in order that CPU may memorize the data in the middle of an 
peration (Random Access Memory), ROM which memorizes the program which CPU performs, a table, a map. 
tc. (Read Only Memory), It has the output circuit which outputs the driving signal of a loudspeaker 3, the status 
ignal of a display 4, etc., and the output signal of Cameras 1R and 1L, Photosensors 2R and 2L, and the 
utside-air-temperature sensor 8 is changed into a digital signal, and it is constituted so that it may be inputted 
ito CPU. 

D014] The image obtained by the infrared camera turns into the image which does not almost have change of 
rightness, i.e., the image for which contrast was insufficient, when so high [ that the 1 outside air temperature 
"A became comparable as the temperature of an animal ] and dirt, such as mud and snow, adheres to the optical 
ystem of 2 infrared cameras, and when the temperature gradient of the object picturized by 3 infrared cameras 
3 small. So, with this operation gestalt, the case of the above 1 and 2 is distinguished and detected by 
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Drocessing of drawing 4 explained below, and it warns an operator. Moreover, when dirt adheres to infrared 
Dameras 1R and IL. paying attention to the point that the light-receiving quantity of light of the arranged 
Dhotosensors 2R and 2L close to these cameras falls, the dirt of the above 2 is detected based on the light- 
-eceiving quantity of light of Photosensors 2R and 2L 

.0015] Drawing 4 is a flow chart which shows the procedure of contrast insufficient detection processing of the 
mage performed by CPU of the image-processing unit 2. First, at step SI 1Jf it stands by until the headlight 
switch 7 is turned on, and the headlight switch 7 is turned on and Headlights 21 R and 21 L are turned on, it will 
distinguish whether outside air temperature TA is higher than the predetermined temperature TAH (for example, 
30 degrees C) (step S12). When it is TA<=TAH, it progresses to step SI 4 immediately, and when it is TA>TAH, ' 
since outside air temperature TA is high, it warns an operator of the contrast of the image obtained by infrared 
cameras 1R and 1L running short (step SI 3), and progresses to step SI 4. 

.0016] At step SI 4, the quantity of light ILR detected by photosensor 2R distinguishes whether it is no smaller 
:han the predetermined threshold ILREF. and it warns an operator of the contrast of the image obtained by 
adhesion of dirt by infrared camera 1R running short, when it is ILR<ILREF, while progressing to step SI 6 
mmediately. when it is ILR>=ILREF (step SI 5), and progresses to step SI 6. Here, the predetermined threshold 
LREF actually measures the photosensor output in the condition of various dirt, and is experimentally set as the 
optimal value. 

.0017] At steps SI 6 and SI 7. the same processing as steps SI 4 and S15 is performed about the quantity of 
ight ILL detected by photosensor 2L, and when it is ILL<ILREF, it warns an operator of the contrast of the 
mage obtained by adhesion of dirt by infrared camera 1L running short (step SI 7). 
.0018] Warning in the above-mentioned steps SI 3, SI 5, or SI 7 is performed the voice which used the 
oudspeaker 4, or by displaying warning in an alphabetic character on a display 5. In the condition of having 
lurned on Headlights 21 R and 21L with this operation gestalt as mentioned above Photosensor 2R which 
eceives the reflected light of the light which approaches infrared cameras 1R and 1L, is arranged, and is emitted 
rom a headlight. Since it was made to judge with dirt having adhered to the optical system of infrared cameras 
IR and 1L when the light-receiving quantity of lights ILR and ILL of 2L were smaller than the predetermined 
hreshold ILREF. dirt can be detected with an easy configuration, without using the new light source for dirt 
letection. 

P019] Furthermore with this operation gestalt. with the lack of contrast resulting from the dirt of a camera 
Jince the lack of contrast to which outside air temperature TA originates in a high thing is also detected, both 
ire distinguished and it was made to warn an operator When the lack of contrast of an image occurs, an operator 
vill not be based on the abnormalities (dirt) of a camera. Or outside air temperature will not be based on a high 
hing, it distinguishes whether it is what the temperature gradient of an object depends on a small thing, and only 
ecognizes, and it becomes possible to take a measure with appropriate in the case of dirt wiping off dirt etc, 
0020] (2nd operation gestalt) This operation gestalt attaches Photosensors 2R and 2L in the interior of the 
lousing 30 of Headlights 21 R and 21L, as shown in drawing 6 , and detects the dirt of the front cover 31 which 
he light by which outgoing radiation was carried out from the light source 32 of a headlight penetrates while it 
ipproaches Headlights 21 R and 21 L, respectively and arranges infrared cameras 2R and 2L. That is, when dirt 
idheres to the front cover of a headlight, it presumes that possibility that dirt has adhered also to the infrared 
lamera is high, and warns an operator. 

0021] Drawing 5 is a perspective view for explaining the configuration of camera housing 11R in this operation 
jestalt, and photosensor 2R is connected to the signal input terminal in housing through the wire. Moreover, in 
he example shown in this drawing, it connects with the signal input terminal in housing through the wire in order 
o also separate the outside-air-temperature sensor 8 from camera housing 11 R for a while and to attach it. 
Jamera housing 1 1L is similarly constituted except for the point which is not equipped with the outside-air- 
emperature sensor 8. 

0022] As photosensor 2R is shown in drawing 6 , it is attached in the interior of the headlight housing 30 with 
he bracket 33, and the light 41 reflected by the front cover 31 among the light by which outgoing radiation is 
:arried out from the light source 32 is constituted so that incidence may be carried out to photosensor 2R. 
Photosensor 2L is similarly attached in the interior of housing of headlight 21L 

0023] Drawing 7 is a flow chart which shows the procedure of the contrast insufficient detection processing in 
his operation gestalt This processing changes steps SI 4 and S16 into step SI 4a and 16a in processing of 
Irawing 4 , respectively, and steps other than this are the same as that of processing of drawing 4 . 
0024] With this operation gestalt. since Photosensors 2R and 2L have been arranged in headlight housing, the 
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ght income ILRa and ILLa of reflected lights, i.e., the amount from a front cover 31, increases, so that extent of 
he dirt of a front cover 31 increases. Therefore, in step SI 4a and SI 6a, it distinguishes whether light income 
LRa and ILLa is larger than the predetermined threshold ILREFa, and when it is ILRaMLREFa, it warns of the 
ack of contrast of the image which judges with dirt having adhered to infrared camera 1R, and is obtained by 
:amera 1R (step SI 5). Similarly, when it is ILLaMLREFa, it warns of the lack of contrast of the image which 
jdges with dirt having adhered to infrared camera 1L, and is obtained by camera 1L (step SI 7). 
0025] Except the above point, it is the same as that of the 1 st operation gestalt. In the condition of having 
urned on Headlights 21 R and 21 L according to this operation gestalt When the quantity of lights ILRa and ILLa 
'f the light which reflects in a front cover 31 among the light emitted from the light source 32 of a headlight and 
5 received by Photosensors 2R and 2L are larger than the predetermined threshold ILREFa. Since it was made 
o judge with dirt having adhered to the optical system of infrared cameras IR and 1L, the same effectiveness as 
he 1st operation gestalt can be acquired. 

0026] With the operation gestalt mentioned above, CPU of the image-processing unit 3 constitutes a dirt 
letection means, and, more specifically, steps S11, S14-S17 of drawing 4 or step S11 of drawing 7 . S14a, S15, 
516a, and SI 7 are equivalent to a dirt detection means. 

D027] In addition, this invention is not restricted to the operation gestalt mentioned above, and various 
leformation is possible for it For example, the camera housing 11R and 11 L does not need to approach 
leadlights 21 R and 21 L, it is not necessary to necessarily arrange it and you may make it arrange it in the 1st 
peration gestalt to near the middle point and the undershirt grill 23 of a headlight on either side of a front grille 
2. 

0028] Moreover, in the 2nd operation gestalt, although the camera housing 11R and 11L which held infrared 
ameras IR and 1L has been arranged to the front grille 22 close to Headlights 21 R and 21 L The camera housing 
IR and 11L is constituted in Headlights 21 R and 21 L (headlight housing 30) and one, as shown in drawing 8 , a 
'ont cover 31 is lengthened a little in a longitudinal direction, and you may make it arrange the camera housing 
1 R and 1 1L to the inside. Moreover, the number of infrared cameras may not be restricted to two pieces, and 
nay be one piece or three pieces or more. 
0029] 

Effect of the Invention] Since according to this invention the amount of reflected lights of the light emitted from 
he headlight of a car is detected and the dirt of an infrared camera is detected by the arranged photosensor 
lose to an infrared camera based on the this detected quantity of light as explained in full detail above, it is not 
ecessary to establish the light source for dirt detection, and the dirt of an infrared camera can be detected 
/ith an easy configuration. 
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